TOKENIZE SEXP

 Function
  Split up a string into tokens separated by semi-colons or spaces.

 Syntax
  TOKENIZE SEXP

   SEXP  - Any string expression.

 Remarks
  One of the strongest features of PCBoard is it's ability to take a
  series of stacked parameters from a command line and use them all at
  once instead of requiring the user to navigate a series of menus and
  select one option at each step of the way.  TOKENIZE is the PPL
  equivalent of what PCBoard uses to break a command line into individual
  commands (tokens).  The number of tokens available may be accessed via
  TOKCOUNT(), and each token may be accessed, one at a time, by GETTOKEN
  and/or GETTOKEN().

 Examples
  STRING  cmdline
  INPUT "Command",cmdline
  TOKENIZE cmdline
  PRINTLN "You entered ",TOKCOUNT()," tokens"
  WHILE (TOKCOUNT() > 0) PRINTLN "Token:  ",CHR(34),GETTOKEN(),CHR(34)